While these tutorials are typically meant to be visualized in serial, viskex also runs in parallel. To exemplify this, we will show a parallel case using ipyparallel.
First of all, we start a ipyparallel MPI cluster with 2 processes.
import ipyparallel as ipp
cluster = ipp.Cluster(engines="MPI", profile="mpi", n=2)
cluster.start_and_connect_sync()
Starting 2 engines with <class 'ipyparallel.cluster.launcher.MPIEngineSetLauncher'>
<ipyparallel.client.client.Client at 0x7f7f00e565a0>
The jupyter magic %%px will run the following cells on the ipyparallel cluster.
%%px
import firedrake # noqa: E402
import mpi4py.MPI # noqa: E402
%%px
import viskex # noqa: E402
To confirm that we are running in parallel, we can print the rank of the current process and the total number of processes.
%%px
comm_world = mpi4py.MPI.COMM_WORLD
print(f"rank = {comm_world.rank}, size = {comm_world.size}")
[stdout:0] rank = 0, size = 2
[stdout:1] rank = 1, size = 2
Generate a mesh on MPI_COMM_WORLD of the unit square by dividing each edge of the square in 6 segments.
%%px
square_world = firedrake.UnitSquareMesh(
6, 6, comm=comm_world, distribution_parameters={"partitioner_type": "simple"})
Plot the mesh defined on MPI_COMM_WORLD. Each rank will plot its local cells, and their neighbors (called halos in firedrake).
%%px
viskex.firedrake.plot_mesh(square_world)
[output:1]
[output:0]
For comparison, we can generate a similar mesh on MPI_COMM_SELF. Each rank will have its own copy of the whole mesh.
%%px
comm_self = mpi4py.MPI.COMM_SELF
square_self = firedrake.UnitSquareMesh(
6, 6, comm=comm_self, distribution_parameters={"partitioner_type": "simple"})
Plot the mesh defined on MPI_COMM_SELF. Each rank will produce a plot which is visually the same, since each rank has its own copy of the same mesh.
%%px
viskex.firedrake.plot_mesh(square_self)
[output:1]
[output:0]
We finally stop the ipyparallel cluster. Note that when running with Run -> Run all cells all interactive plots will be closed when the kernel executes this cell.
cluster.stop_cluster_sync()
Stopping controller
Controller stopped: {'exit_code': 0, 'pid': 4372, 'identifier': 'ipcontroller-1753990267-46l8-4354'}
Stopping engine(s): 1753990268
Output for ipengine-1753990267-46l8-1753990268-4354: 2025-07-31 20:31:09.430 [IPEngine] Loading connection info from $IPP_CONNECTION_INFO 2025-07-31 20:31:09.430 [IPEngine] WARNING | Not using CurveZMQ security 2025-07-31 20:31:09.448 [IPEngine] Loading connection info from $IPP_CONNECTION_INFO 2025-07-31 20:31:09.448 [IPEngine] WARNING | Not using CurveZMQ security 2025-07-31 20:31:09.679 [IPEngine.0] Registering with controller at tcp://127.0.0.1:54723 2025-07-31 20:31:09.679 [IPEngine.1] Registering with controller at tcp://127.0.0.1:54723 2025-07-31 20:31:09.680 [IPEngine.0] Requesting id: 0 2025-07-31 20:31:09.680 [IPEngine.1] Requesting id: 1 2025-07-31 20:31:09.682 [IPEngine.0.0] Shell_addrs: ['tcp://127.0.0.1:58567', 'tcp://127.0.0.1:33447', 'tcp://127.0.0.1:42813'] 2025-07-31 20:31:09.682 [IPEngine.0.0] Connecting shell to tcp://127.0.0.1:58567 2025-07-31 20:31:09.682 [IPEngine.0.0] Connecting shell to tcp://127.0.0.1:33447 2025-07-31 20:31:09.682 [IPEngine.0.0] Connecting shell to tcp://127.0.0.1:42813 2025-07-31 20:31:09.682 [IPEngine.0.0] Starting nanny 2025-07-31 20:31:09.683 [IPEngine.1.1] Shell_addrs: ['tcp://127.0.0.1:58567', 'tcp://127.0.0.1:33447', 'tcp://127.0.0.1:35021'] 2025-07-31 20:31:09.683 [IPEngine.1.1] Connecting shell to tcp://127.0.0.1:58567 2025-07-31 20:31:09.683 [IPEngine.1.1] Connecting shell to tcp://127.0.0.1:33447 2025-07-31 20:31:09.683 [IPEngine.1.1] Connecting shell to tcp://127.0.0.1:35021 2025-07-31 20:31:09.683 [IPEngine.1.1] Starting nanny 2025-07-31 20:31:10.094 [KernelNanny.1] Starting kernel nanny for engine 1, pid=4408, nanny pid=4419 2025-07-31 20:31:10.094 [KernelNanny.1] Nanny watching parent pid 4408. 2025-07-31 20:31:10.098 [KernelNanny.0] Starting kernel nanny for engine 0, pid=4407, nanny pid=4418 2025-07-31 20:31:10.098 [KernelNanny.0] Nanny watching parent pid 4407. 2025-07-31 20:31:10.155 [IPEngine.1.1] Loading IPython extension: storemagic 2025-07-31 20:31:10.156 [IPEngine.1.1] Running code in user namespace: from mpi4py import MPI mpi_rank = MPI.COMM_WORLD.Get_rank() mpi_size = MPI.COMM_WORLD.Get_size() 2025-07-31 20:31:10.158 [IPEngine.1.1] WARNING | debugpy_stream undefined, debugging will not be enabled 2025-07-31 20:31:10.159 [IPEngine.1.1] Starting to monitor the heartbeat signal from the hub every 3500 ms. 2025-07-31 20:31:10.159 [IPEngine.1.1] Completed registration with id 1 2025-07-31 20:31:10.160 [IPEngine.0.0] Loading IPython extension: storemagic 2025-07-31 20:31:10.161 [IPEngine.0.0] Running code in user namespace: from mpi4py import MPI mpi_rank = MPI.COMM_WORLD.Get_rank() mpi_size = MPI.COMM_WORLD.Get_size() 2025-07-31 20:31:10.162 [IPEngine.0.0] WARNING | debugpy_stream undefined, debugging will not be enabled 2025-07-31 20:31:10.164 [IPEngine.0.0] Starting to monitor the heartbeat signal from the hub every 3500 ms. 2025-07-31 20:31:10.164 [IPEngine.0.0] Completed registration with id 0 2025-07-31 20:31:14.682 [IPEngine.1.1] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_2 2025-07-31 20:31:14.682 [IPEngine.0.0] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_1 2025-07-31 20:31:16.371 [IPEngine.0.0] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_3 2025-07-31 20:31:16.371 [IPEngine.1.1] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_4 2025-07-31 20:31:16.974 [IPEngine.0.0] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_5 2025-07-31 20:31:16.975 [IPEngine.1.1] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_6 2025-07-31 20:31:16.985 [IPEngine.0.0] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_7 2025-07-31 20:31:16.985 [IPEngine.1.1] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_8 2025-07-31 20:31:16.997 [IPEngine.0.0] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_9 2025-07-31 20:31:16.997 [IPEngine.1.1] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_10 2025-07-31 20:31:17.891 [IPEngine.0.0] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_11 2025-07-31 20:31:17.892 [IPEngine.1.1] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_12 2025-07-31 20:31:17.903 [IPEngine.0.0] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_13 2025-07-31 20:31:17.904 [IPEngine.1.1] Handling execute_request: a95f3aac-aa18b92573dfa15c9ba9a841_4354_14
engine set stopped 1753990268: {'exit_code': 1, 'pid': 4400, 'identifier': 'ipengine-1753990267-46l8-1753990268-4354'}